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Abstract 

In this paper, we propose a novel algorithm to maximize the sum rate in interference-limited 
scenarios where each user decodes its own message with the presence of unknown interferences and 
noise considering the signal-to-interference-plus-noise-ratio. It is known that the problem of adapting the 
transmit and receive filters of the users to maximize the sum rate with a sum transmit power constraint 
is non-convex. Our novel approach is to formulate the sum rate maximization problem as an equivalent 
multi-convex optimization problem by adding two sets of auxiliary variables. An iterative algorithm 
which alternatingly adjusts the system variables and the auxiliary variables is proposed to solve the 
multi-convex optimization problem. The proposed algorithm is applied to a downlink cellular scenario 
consisting of several cells each of which contains a base station serving several mobile stations. We 
examine the two cases, with or without several half-duplex amplify-and-forward relays assisting the 
transmission. A sum power constraint at the base stations and a sum power constraint at the relays are 
assumed. Finally, we show that the proposed multi-convex formulation of the sum rate maximization 
problem is applicable to many other wireless systems in which the estimated data symbols are multi- 
affine functions of the system variables. 
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I. Introduction 

Several sophisticated solutions have been studied for future cellular systems aiming at im¬ 
proving both the uplink and downlink data rates. For instance, introducing multiple antennas 
at both base stations (BSs) and mobile stations (MSs) greatly increases the achievable rates 
m-m. Furthermore, employing relays in these systems extends the coverage and enhances 
the performance [31, [Ell- However, interference is still the main performance limiting factor in 
cellular systems. The transmission rate, especially when the MSs are located at the cell edges, is 
greatly influenced by the inter-cell interferences. For instance for a cell edge MS, the received 
interference signal in the downlink can be severe and even of a comparable strength as the 
useful signal, which degrades the achieved rate significantly. To enhance the performance in 
cellular systems, smart spatial signal processing techniques at the BSs and the MSs, and also 
at the relays if they are employed in the system, need to be found. Apart from joint processing 
techniques which require data exchange among the cooperating parties, we focus on distributed 
signal processing techniques which require only the exchange of channel state information. 

Before discussing the sum rate, we first briefly review two interference reduction techniques 
which have been studied extensively, i.e., interference alignment (IA) and sum mean square error 
(MSE) minimization. IA is achieved by aligning all the interferences in a smaller subspace of 
the received signal space while keeping the useful signal subspace interference free (6l, 0. 
IA has received great attention in the last few years |(8l- llT2l . Basically, the IA problem has 
the nice property that it is a multi-affine problem. Therefore, it can be tackled by alternatively 
solving several linear subproblems []8]|, lITOl . For instance, the IA problem is a tri-affine problem 
if relays are employed. Firstly, the filters of the BSs are optimized with fixed relay processing 
matrices and fixed filters at the MSs. Secondly, the relay processing matrices are optimized 
with fixed filters at the BSs and MSs. At the third step, the filters of the MSs are optimized 
with fixed filters at the BSs and fixed relay processing matrices. However, since IA ignores the 
received noise, it performs poorly at low and moderate signal to noise ratios (SNRs) lfl3l . On 
the other hand, optimizing the spatial filters at the BSs and the MSs, as well as the processing 
matrices at the relays if they are employed, for minimizing the sum MSE always achieves a 
compromise between interference reduction and noise reduction. In general, the sum MSE is not 
a convex function. However, it is a convex function of either the filters at the BS, the filters at 
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the MSs or the relay processing matrices alone. This multi-convex structure of the sum MSE 
function also allows alternating minimization algorithms to achieve a local minimum fM - lITTll . 
Nevertheless, minimizing the sum MSE does not necessarily imply achieving the maximum sum 
rate. Furthermore, it is worth to mention here that minimizing the sum bit error rate (BER) is an 
alternative objective to minimizing the sum MSE liT8l . However, it is complicated to optimize 
the sum BER in multi-user multi-antenna scenarios as the BER has no closed form solution. 

Besides the techniques mentioned above, directly maximizing the sum rate is a promising goal 
for efficiently utilizing the limited available system resources lfl9l . If the interference is treated 
as noise and some power constraints are considered, the sum rate maximization problem is a 
non-convex optimization problem ll20ll . ifUTl . This non-convexity of the sum rate maximization 
problem holds even if we optimize over either the filters at the BSs only, the filters at the 
MSs only or the relay processing matrices only. Therefore, iterative alternating optimization 
algorithms cannot be directly implemented here. 

In the last decade, a lot of progress has been made in finding efficient sum rate maximization 
algorithms. Algorithms from global optimization theory are proposed for finding the global max¬ 
imum of the sum rate Il22ll - ll24l . Nevertheless, these algorithms suffer from high computational 
complexity which limits their practicality to small scenarios only. Unlike the computationally 
expensive global optimization algorithms, relatively low complexity suboptimum algorithms have 
also received great attention. Basically, the special structure of the sum rate function can be 
exploited to achieve a near optimum sum rate. In lf25l . an interference broadcast channel is 
considered. Instead of maximizing the sum rate, the authors maximizes the product of the 
SNRs at the MSs. Rather than optimizing the filters at the BS and the MSs all together, it 
is shown that the problem can be simplified to three subproblems, which are not necessarily 
convex. Each subproblem aims at optimizing either the transmit powers, the BS filters or the MS 
filters. Geometric programming is employed for approximating the solution of the non-convex 
subproblems. In lf26l . some auxiliary variables are used to simplify the sum rate maximization 
problem in a broadcast channel. The authors introduce new variables to the problem such that 
the multiple constraints can be equivalently written as a single constraint. The sum rate function 
can be written as a difference of two concave functions ll22ll . If27l . Accordingly, the authors of 
|[27l linearly relax the second term and solve the resulting problem iteratively. 

Some authors also exploit the minimized MSE to maximize the sum rate. From the information 
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theory perspective, Guo et. al. have found that there is a linear relationship between the derivative 
of the mutual information and the minimum MSE for Gaussian channels ll28l . Moreover, it is 
shown in ||29l that this relationship holds for any wireless system with linear filters. Considering 
a broadcast channel scenario, the relationship between the derivative of the mutual information 
and the minimum MSE can be exploited by designing the receive filters such that the MSE 
at the receivers is minimized. In this case, the MSE will be a function of the transmit filters 
[[Ml . Accordingly, the sum rate maximization problem for optimizing the transmit filters can be 
formulated as a minimization of the sum of log-MSEs. An approximate solution of this new 
formulation is found using geometric programming OMl . Designing the receive filters to minimize 
the MSE and optimizing the remaining variables to maximize the sum rate is also considered 
in [l32l . It is shown that by relaxing the sum rate maximization problem and adding some 
auxiliary variables, a successive convex approximation approach can be applied lf32l . Because 
of the problem relaxations, this approach does not converge to neither a local maximum nor the 
global maximum of the original problem. For a broadcast channel scenario, the receive filters are 
designed aiming at minimizing the MSE and by adding some auxiliary variables, the sum rate 
maximization problem is reformulated as a biconvex optimization problem of the transmit filter 
and the added auxiliary variables ll30l . This work is extended to many different scenarios such 
as MIMO interference channels |[33l . interfering broadcast channels 041 . and relay interference 
channels P5l . The main drawback of this approach is that the receive filters are not optimized 
to maximize the sum rate. 

In the present paper, we aim at formulating the sum rate maximization problem as a multi- 
convex problem so that it can be efficiently solved by low complexity iterative algorithms. 
We specifically consider the downlink transmission in a cellular scenario with BSs serving 
multiple MSs, although the same approach can be applied to the uplink transmission as well. 
The transmission from the BSs to the MSs takes place either through several non-regenerative 
relays or directly without relays. First, we focus on describing our approach for a two-hop 
transmission scheme where relays are employed. Then, we show that the approach can also be 
applied to other wireless systems by taking the single-hop transmission scheme without relays 
as an example. The key idea of our approach is to replace the signal to interference plus noise 
ratio (SINR) at a MS by a new term whose maximal value is found to be 1+SINR. Using this 
new term, we formulate a multi-concave objective function. We will show that this objective 
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function has the same maxima as the sum rate function and, therefore, maximizing this objective 
function is equivalent to maximizing the sum rate function. 

The rest of this paper is organized as follows. In the next section, a two-hop transmission 
scenario and a single-hop transmission scenario are described. In Section UHl the two-hop 
transmission is first investigated and based on it, the multi-convex formulation of the sum rate 
is derived. An iterative sum rate maximization algorithm is proposed in Section IIII-E1 To show 
that our idea is quite general and fits in many scenarios, we derive the multi-convex problem 
formulation for the single-hop transmission in Section [TV] A few additional aspects are discussed 
in Section [V] and the performance of the proposed algorithm is shown in Section [VH In Section 
IVIIl the conclusions are drawn. 

II. System model 

A. Two-Hop Interference Broadcast Scenario 

In this paper, we will consider two related scenarios, i.e., a two-hop interference broadcast 
scenario and a single-hop interference broadcast scenario. The former will be described here, 
and the latter will be described in Section III-B1 

A downlink cellular scenario consisting of K cells is considered. Each cell contains a BS 
with A'b antennas, and M MSs with Am antennas each. We first assume that the direct channels 
between the BSs and the MSs are relatively weak due to the radio environment so that they 
can be neglected. To enable the communication between the BSs and the MSs, R half-duplex 
relays with A; antennas each are deployed in the scenario. The transmission takes place in two 
subsequent time slots as illustrated in Fig. [I] In the first time slot, the BSs transmit to the relays. 
In the second time slot, the relays retransmit a linearly processed version of what they received 
in the first time slot to the MSs. The channels between the communication parties are assumed 
to remain constant during the transmission. To simplify the discussions, we assume that each 
MS receives a single desired data symbol from the corresponding BS. Accordingly, each BS 
transmits simultaneously M complex valued data symbols with M < Nb- A direct extension to 
the case where multiple data symbols are desired will be briefly discussed in Section [77] 

Let k e {1,..., K}, m G {1,..., KM}, and r e {1,..., R} denote the indices of the BSs, 
the MSs, and the relays, respectively. Then, the data symbol transmitted by the corresponding BS 
for the m-th MS is denoted by S ni) 6 C and all the data symbols transmitted by the k- th BS are 
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Fig. 1. A K cell scenario with K BSs, R relays and I\M MSs. The transmissions in the first and the second time slot are 
illustrated by the dotted and solid arrows, respectively. 


denoted by the vector d — G C M . For each BS k, the transmitted data symbols are pre-processed 
by a linear transmit filter denoted by V (k> G C NbxM . The signal vector transmitted by the A-th 
BS reads 

sg° = V (fc) d (fe) . (1) 

The received signal vector at the r-th relay is 

K 

(■r) \ ' rr(r,l:) (k) . (r) 

e R = 2^ H RB S B + n R.S (2) 

k =1 

where H^' 1 G C NrxNb denotes the channel matrix between the A'-th BS and the r-th relay, and 
n[['’ G C iVRXl represents the noises at the different antennas of the relay, which are assumed 
to be independently identically distributed (i.i.d.) Gaussian with zero mean and variance a 2 . It 
is assumed that the number A r j { of antennas at a relay is not large enough to spatially separate 
the received signals, i.e., AVr < KM. Therefore, the amplify and forward relaying protocol is 
considered. The r-th relay linearly processes its received signals with the matrix G' 7 '- 1 G C NrxNr 










7 


and the transmitted signal of the r-th relay is denoted by 


s 


= G W e R 


(r) 


(3) 


Furthermore, the received signal vector at the m-th MS is 

R 

pW - V H (m,r) s (r) 4- n (m) ( 4 ) 

e M “ n MR ®R m n M ) V*) 

r =1 

where H^ R r) G C NmxNr denotes the channel matrix between the r-th relay and the m-th MS, 
and G C NmXl represents the noises at the MS, which are also assumed to be i.i.d. Gaussian 
with zero mean and variance a 2 . Then the m-th MS can linearly post-process its received signal 
vector using a linear receive filter u- m ) G C iVMXl to obtain the estimated data symbol as 

d (m) = u (m) * T eP 

_ u (m)*T (EE H £m ) G (r)H RB ) V (fc) d (fc) 

r=l k= 1 

+ X;Hi 4 T , G'-')„« + .C»). (5) 

r=1 

Suppose the duration of each time slot is normalized to one, it is assumed that the transmitted 
data symbols are uncorrelated and they have the same average power 

E {|d (m) | 2 } = P d , (6) 

for all m = 1 ,,KM where E {•} denotes the expectation. Moreover, the sum power constraint 
at the BSs is given by 

Etr(E{si ! l) S ™* T }) <P B , (7) 

k= 1 

The sum power constraint at the relays is given by 

E‘ r (E{4’4 ,,T })<^ ® 

r= 1 


B. Single-Hop Interference Broadcast Scenario 

The second scenario we consider is similar to the one described in Section ITl-Al except that the 
direct channels between the BSs and MSs are assumed to be usable and no relays are deployed. 





Fig. 2. A K cell scenario with K BSs and KM MSs. 


The MSs receive signals directly from the BSs within a single time slot as illustrated in Fig. [2] 
Therefore, the received signal vector at the m-th MS reads 

K 

(m) \ A TT (m,k) (k) . (m) 

e M =Z^ H MB S B + n M > ( 9 ) 

k =1 

where e C /VmX;Yb denotes the channel matrix between the m-th MS and the k -th BS. 

Similar to ©, the estimated data symbol at the m-th MS is calculated as 

d (m) = u (m) * T HSTB fc)v(fc) d (fc) + j . (10) 

Furthermore, only the power constraint (7]) at the BSs is relevant for the single-hop scenario. 

III. TWO-HOP TRANSMISSION SCHEME 

A. Problem formulation 

To simplify the notations for the rest of this paper, we will partition the system variables into 
three disjoint sets with the variables being kept in a certain order for plugging them in a function 
argument, namely the tuple of the transmit filters 


¥ = (VW,...,V (X) ) , 


(11) 












the tuple of the relay processing matrices 


G= (G (1) ,...,G (h) ) , (12) 

and the tuple of the receive filters 

U= (u (1) ,...,u^ M) ). (13) 

In this section, we formulate the sum rate maximization problem for the two-hop interference 
broadcast scenario described in Section III- A1 Using the notations introduced above, it can be 
observed from © that the estimated data symbol d irn} at the m-th MS is a tri-affine function of 
the tuple V of the transmit filters, the tuple G of the relay processing matrices, and the receive 
filter u( m ). Let denote the m-th column of V (fc ). Then, © can be rewritten as 

d {m) = u (m) * T + z (m) ) , (14) 


where 


R 




(r,k) (k,m) 


r =1 


(15) 


is the effective useful link of the m-th MS including the relays and the transmit filter vector 
v (fc,m) p cl f( m ) be an M x M diagonal matrix where all the diagonal elements are ones except 
for the m-th diagonal element being zero. The received interference plus noise at the m-th MS 
is given by 


R 

z (m) = ^H^ r) G (r) HK ) V w T (m) d (t) 

r =1 

+ EH& r) G <r, £H£fvmd<<> 

r=1 l^k 

R 

+ Z^ tl MR ^ n R + n M ' 

r =1 

The first term and the second term of (fT6l) represent the received intra-cell and inter-cell 
interference, respectively. The last two terms of (fl6l) describe the noises received by the m- 
th MS, including the noise retransmitted by the relays. Based on this, the receive SINR at the 
m-th MS can be written as 

P d | u ( m )* T q( m ) 


2 
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and thus, the sum rate is calculated as 

KM 

C(V,G,U) = ^log 2 (l + 7 (m) ), (18) 

m= 1 

which is a function of the tuples of variables ¥, G, and U. For the considered two-hop trans¬ 
mission scheme, the sum rate maximization problem for optimizing the transmit filters, the relay 
processing matrices and the receive filters with the sum power constraints at the BSs and at the 
relays can be stated as 


subject to 


(Vopt, G opt , U opt ) = argrnax {C (¥, G, U)} 

(V,G,U) 


P d Y tr (V (fe) V (fc) * T ) < P B 

k =1 


(19) 


( 20 ) 


P d Y tr ( G (r l Y H Si fc) V (fc) V (,i) * T Hji fc) * T G (r) * T 

r=1 \ k =1 

R 

+ a 2 Y tr (G (r) G (r) * T ) < P R , (21) 

r =1 

where the constraints of (l20l) and (1211) follow from © and respectively. The sum power 
constraint of (l20l) at the BSs is a convex set of the transmit filters. Furthermore, the sum power 
constraint of (1271) at the relays is a biconvex set of the transmit filters and the relay processing 
matrices. However, the objective function - the sum rate function - is not a concave function 
of ¥, G, and U. Therefore, the optimization problem of (fT9l)-(l2TT) is a non-convex problem. 


B. Signal to Interference plus Noise Ratio 

With a closer look at the structure of the sum rate function of (fl8l) . one can observe that the 
achieved rate at a MS is a logarithmic function of 1+SINR. Basically, the main difficulty of 
handling the SINR function of (fI71) is that both its nominator and denominator are functions 
of the system variables, see (fl5l) and (fl6l) . In order to reformulate the optimization problem of 
dH-dzB as a multi-convex optimization problem, a term related to the SINR is introduced in 
the following proposition. 
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Proposition 1: Let w {rn) G C be a scaling factor which scales the m-th transmitted data 
symbol S m \ Then, the function 

E /1w (m) d (m) | 2 


^(m)) _ 


E 


J(m) _ jpHdH 


( 22 ) 


has a single maximum being equal to 1 + where is defined in (fT71) . 
Proof: Using the function 

g (¥, G, u (m) , w {m) ) = E | S m) - w (m) S m) 


= P, 


u (m)*Tq(m) _ w (m ) 


+ E{|u (m) * T z (m) | 2 ), 


can be written as 


p 


M («,("*)) = 


P d |w (m) l 


(23) 


(24) 


g (V, G, u( m ),uiM) 

Since <P m ) described in ([5]) is a tri-affine function of ¥, G, and the function 
g (¥, G, u ( m ) 5 described in (1231) is a tri-convex function of ¥, G and for a fixed w <jn \ 
By calculating the general derivative of //' m| with respect to vf rn> and setting the result to zero, 
two stationary points can be calculated as 


(m) n 
Wq — 0 


and 


(m) 

Kpt = 


P d | u M*Tq(m )| 2 + E j | u (m)*T z (m) 


P d q( m )* T u ( m ) 


(25) 


(26) 


By substituting (1251) and (l26l) in (l24l) . the values of 7 /'+ at uy "' and , respectively, are 


calculated as 


and 


77 M (4 m) ) = 0 


(27) 


» (m) ¥S) = 


P d |u^* T q( m M 2 + E {| U M* T Z M| 2 


E i |u( m )* T z( m )| 


= 1 + 7 


(m) 


(28) 
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Considering the fact that the function described in (l22l) is non-negative and 

lim ?/ m) = 1, (29) 

\w( rn ) |—>-oo 

the function must achieve its maximum at . ■ 

The nice property of is that just its denominator is a function of the system variables 
¥, G, and whereas for 7 (t E defined in ([ITT) , both the nominator and the denominator are 
functions of the system variables. 

C. Problem reformulation 

In the previous section, it has been shown that the term is equivalent to the received 
SINR at the m-th MS when the scaling factor w^ is optimized using (l26l ) . Let 

w=(w^\...,w^) T (30) 

be a vector of the scaling factors and let the elements of w opt be chosen as (1261) . Then, the 
function 

K M 

f 2 ho P (V,G,U,w) = EE log 2 ( 7 (m) ) (31) 

k =1 m =1 

is equivalent to the sum rate function of (fl8l) in the sense that both have the same local and 
global maxima if w = w opt holds. To show the concavity of f 2 h op with respect to the tuples ¥, 
G and U, using (l24l) . (071) can be rewritten as 

K M 

f 2hop (¥, G, U, w) = ]T log 2 (P d |m^| 2 ) 

k= 1 m= 1 
K M 

-EE lo S2 (g (V, G, . (32) 

fc=l m= 1 

In (l32l) . just the second term includes the system variables. Although the function 

g (¥, G, u( m ) ; w( m )) is a tri-convex function of ¥, G and when w ( - m - ) is fixed, 

log 2 (g (¥, G, w^X) is not necessarily convex lf36l . Accordingly, we aim at finding a new 

equivalent objective function which is linear in g (¥, G, u (m E such that we can exploit the 

fact that g (¥, G, u( m ) ; w ( m )) i s a multi-convex function of the system variables. 
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D. Multi-convex problem formulation 


In this section, the optimization problem of (fl9l)- (l2TI) is reformulated as a multi-convex 
optimization problem. Let 


t = 


(t ((“))’ 


(33) 


be a vector of additional scaling factors. Then, the function 

KM, 

b 2hop (¥,G,U, w,t) = ^ ^ ( lo §2 (Pd |^ (m) f) 

k =1 m =1 ' 

+(m) \ 

+ log, (i< m >) - Jg (V, G, u'”', »<"*>) J (34) 

is obviously a concave function of t. By taking the first order derivative of b 2 ho P with respect 
to t rn) and setting the result to zero, the optimum scaling factor t im> is calculated as 


= _ nit 

opt g(V,G,uW,K;H)' 1 ; 

Substituting (l35l) in (l34l) yields 

KM 

b 2 ho P (V, G, U, w, t opt ) = f 2h o P (V, G, U, w) - ( 36 ) 

From (l36l) . it can be concluded that the new objective function b 2 h op (V, G, U, w, t) is equivalent 
to the sum rate function in the sense that they both have the same global and local maxima if the 
optimum scaling factors in w and t are chosen. Moreover, the function b 2 h op (V, G, U, w, t) has a 
single maximum at w = w opt if ¥, G, U, and t are fixed, and the function b 2 h op (V, G, U, w opt , t) 
is 


• a concave function of t if ¥, G, U, and w are fixed because the logarithm is a concave 
monotonically increasing function, 

• a concave function of ¥ if t, G, U, and w are fixed because g (¥, G, rb”b, w^) is a convex 
function of ¥, 

• a concave function of G if t, ¥, U, and w are fixed because g (¥, G, rb”b, -uv m )) i s a convex 
function of G, and 

• a concave function of U if t, ¥, G, and w are fixed because g (¥, G, u ( m ), u>( m '), Vm is 
a convex function of U. 
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Accordingly, the sum rate maximization problem of (fT9l)- (l2TT) can be equivalently formulated 
as a multi-convex optimization problem stated as 


(V opt , G opt ,U 


opt) 


W op t, 



= argrnax {b 2h op (V, G, U, w, t)} (37) 

(V,G,U,w,t) 


subject to 


and 


K 

P d tr (V (fe) V (fc) * T ) < P B 

k =1 


R 


K 


PdJ^tr G (r) ^ V (fc) V w * T Hff T G (r)tT 

r =1 \ k=1 

R 

+ a 2 J^tr (G (r) G (r) * T ) < P R . 


r= 1 


(38) 


(39) 


This problem is a multi-convex problem of V, G, U, and t. 

The vectors w and t of the scaling factors can be optimized using (l26l ) and (031) . respectively. 
With fixed scaling factors, just the last term of (l34l) is relevant for optimizing the system variables 
and thus, the optimization problem (l37l)-(l39l) can be stated as 


subject to 


and 


(Pmin, G min , U min ) 

gmin < . , . . 

[^ m=1 ln(2) 


argmin <j ^ 7 —xrg ( V ’ G ’ uM > ™ M ) 


K 

P d tr (V (fe) V (fc) * T ) < P B 

fc=l 


R 


K 


P d ^tr G (r) ^H^ fc) V (A:) V (A;) * T H{ l ^ ) * T G (r) * T 

r =1 V k =1 

R 

+ a 2 J^tr (G (r) G (r) * T ) < P R . 


r= 1 


(40) 


(41) 


(42) 


As described previously in Section IIII-B1 the function g (V, G, u r;M) i s a tri-convex func¬ 
tion of V, G, and u^ 771 ) for fixed w (m> . Moreover, the power constraints of (l4J~l) and (l42l) are a 
convex set and a biconvex set, respectively. Based on this, the optimization problem of (I40l) - (l42l) 
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is a tri-convex problem for fixed w and t. By taking the general derivative of g (V, G, rfi"'- 1 , v' (rn, 'j 
with respect to u-”b and setting the result to zero, the optimum receive filter is calculated as 

u2 = (P d q (m) q (m) * T + E { Z MzW* T }) _1 

■P d w {m) * q (m) . (43) 

The problem structure with respect to V with fixed G, U, w, and t, is a convex quadratically 
constrained quadratic problem 0711 . Tools from quadratic optimization can be applied to find 
the optimum transmit filters. Similarly, with fixed V, U, w, and t, the optimization problem 
(l40l) - (l42l) can be solved for the tuple G of the relay processing matrices using the conventional 
quadratic optimization tools. 

E. Iterative algorithm 

In this section, an iterative algorithm which alternately maximizes the multi-concave objective 
function b 2 h op (V, G, U, w, t) by sequentially optimizing V, G, U, w and t is described. Let e be 
an arbitrarily small tolerance value. Then, the proposed algorithm can be summarized as follows: 
l: set arbitrary initial values for w (0 \ t (0) and U 1 - 0 ^ 

2 : set feasible initial values for and G^ 

> chosen such that the constraints of (1381) and (l39l) hold 

3: in each iteration i 

4: calculate given yb -1 ) and (gb- 1 ) 

> using (1431) 

5: calculate yb) given wb _1 ), tb _1 \ HJb) and Gb _1 ) 

> using quadratic optimization tools lf38ll 

6: calculate Gb) given H_jb) and yb) 

> using quadratic optimization tools li38l 

7: calculate fb) given yb), Gb) and IJb) 

> using (1351) 

8: calculate given yb), Gb) and HJb) > using (l26l) 

9: stop if |b 2 ho P (VW,GW,UW,wW,tW) 

—b 2 ho P (yb-^cb-^ub- 1 ), wb-b^b- 1 )) | < e 
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From the multi-convex optimization literature Il39ll it is known that the above algorithm 
converges to a local maximum. 


IV. Single-hop transmission scheme 


A. Problem formulation 

In this section, we will show that the proposed multi-convex formulation of the sum rate and 
the iterative algorithm can be applied to the single-hop interference broadcast scenarios described 
in Section III-BI as well. 

From (fTOl) . one can observe that d (mi is a bi-affine function of the tuple V of transmit filters 
and the receive filter u (r, 9 . Then (fTOl) can be rewritten as 

f{m) = u (m)*T ( q (m) d (m) + z (m)J # (44) 

where 

q (m) = H^ fc) v (fc ’ m) (45) 


is the effective useful link corresponding to the m-th MS including the transmit filter vector 
v< ,,vm ), and the effective interference plus noise received at the m-th MS is 

^(m) _ WjW 

+ E H MB ) V ( °d (0 + nir ) . (46) 

l^k 

In (l46l) . the first term and the second term represent the received intra-cell interference and the 
received inter-cell interference, respectively. The noise at the m-th MS is described by the last 
term of (l46l) . 

Substituting (1451) and (l46l) into (IT7l) . the receive SINR at the m-th MS can be calculated. Then, 
the sum rate can be calculated as 

KM 

C(V,U) = ^log 2 (l + 7 ( m )) (47) 

m= 1 

and the sum rate maximization problem can be formulated as 


subject to 


(Vopt, U opt ) = argmax (C (V, U)} 

(V,U) 

P d ^tr (V (fc) V (fc) * T ) < P B . 

k =1 


Similar to the two-hop scenario discussed in Section IIII-A1 this problem is non-convex. 


(48) 


(49) 
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B. Multi-convex problem formulation 

For the single-hop transmission, the function g (¥, vS m \ described in (1231) can be rede¬ 
fined using (1441) . The multi-concave objective function can be written as 

KM, 

bihop (v, U,w,t) = ££ ( log2 ( Pd k (m) r) 

k= 1 771=1 ' 

l( m ) \ 

+ log 2 (t^) - ^g (¥, u (m) , u/ m) ) j . (50) 

Based on this, the sum rate maximization problem can be formulated as a multi-convex opti¬ 
mization problem stated as 


(Vopt, Uopt, w opt , t opt ) = argmax {bi hop (¥, U, w. t)} (51) 

(' V,U,W,T) 

subject to 

K 

P d tr (V (fc) V (fc) * T ) < P B . (52) 

k =1 


This problem is a multi-convex optimization problem of ¥ and U if the optimum w and t are 
a priori chosen. As described in Section IIII-D1 the optimization problem of (|5TT)-(|521) can be 
solved alternatingly over ¥, U, w, and t. The iterative algorithm can be summarized as follows: 
l: set arbitrary initial values for w (0 \ t (0) and U (0i 
2 : set feasible initial values for ¥® 


> chosen such that the constraint of (l52l) holds. 


in every iteration i 


calculate HjW given w^ -1 ) anc [ yb -1 ) 

> using (1431) 

calculate ¥*b given wb _1 ), fb _1 ) and Hjb) 

> using quadratic optimization tools |[38l 

calculate fb) given wb _1 ), yW and Hjb) 

> using (1351) 

calculate wb) given ¥b) and IJb) 

> using (l26l) 


8: stop if jbihop (¥W,UW, wb),fb)) 

-bihop | < e 


V. Further Discussions 

The key idea of the algorithm proposed in this paper is to find a multi-concave objective 
function which is equivalent to the sum rate function in the sense that they have the same maxima, 
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e.g., the function b 2 h op in (l34b and the function bi h0 p in (l50l) . It can be observed from the analysis 
in the previous sections that the new objective function must be a multi-concave function of the 
system variables as long as the function g described in ([23b is a multi-convex function. This 
however only requires that each estimated data symbol (I <m) is a multi-affine function of the 
system variables. Therefore, we may conclude that for a system in which the estimated data 
symbols are multi-affine functions of the system variables, the sum rate maximization problem 
can be equivalently formulated as a multi-convex optimization problem. 

In this paper, we only considered the case where each MS receives a single desired data 
symbol from the corresponding BS. If more than one data symbol is desired by each MS, one 
can expect that the estimated data symbols at a MS are superposed by colored noise. Therefore, 
a pre-whitening filter is required at each MS to decorrelate the noise signals, which results in 
that the estimated data symbols are no longer multi-affine functions of the system variables. 
However, if this correlation among the noise signals is ignored and the received data symbols 
are decoded symbol-wise, an approximate sum rate can still be maximized using the proposed 
algorithm. 


VI. Numerical results 

In the following simulation results, the performance of the proposed sum rate maximization 
algorithm is evaluated in a cellular scenario with K = 2 cells, M — 3 MSs per cell, Nb = 3 
antennas at each BS, R = 4 relays, and Ar = Nm = 2 antennas at each relay and MS. The 
two-hop transmission scheme is applied. Concerning the channel model, we employ an i.i.d. 
complex Gaussian channel model with the average channel gain being normalized to one. To 
assess the performance of our proposed algorithm, two reference schemes are considered. Firstly, 
an IA algorithm is considered where the tuple V of the transmit filters, the tuple U of the receive 
filters, and the tuple G of the relay processing matrices are alternatingly optimized to minimize 
the total interference leakage in the system. The considered IA algorithm is a direct extension 
of the interference leakage minimization algorithm proposed in ® to a multiuser relay scenario. 
The second reference scheme is the sum MSE minimization algorithm which minimizes the sum 
MSE by alternatingly optimizing V, G, and U [fl4| - |[T71l . 

Firstly, the achieved sum rate per time slot is considered as a performance measure. The 
performance of the proposed algorithm is considered as a function of the pseudo SNR which is 
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Fig. 3. Average sum rate per time slot as a function of the pseudo SNR 7 p snr in decibel for a scenario with K = 2, 
M = Nb = 3, R = 4, and Ar = Am = 2 

defined as the ratio of the sum transmit power of all the BSs and relays to the noise variance 
a 2 , i.e., 



(53) 


7psnr — 


Figure [3] shows the performances of the three considered algorithms averaged over many different 
channel snapshots. It can be seen from Fig. [3] that the IA algorithm performs poorly as compared 
to the other two algorithms at low to moderate pseudo SNRs. On the one hand, the IA algorithm 


does not consider noise reduction. On the other hand, the IA algorithm does not intend to 
improve the received powers of the useful signals when minimizing the interferences. That is 
to say, the IA algorithm does not maximize the received SNRs at the MSs. In the pseudo 
SNR region shown in Fig. [3] both the sum MSE minimization and the sum rate maximization 
algorithms achieve superior performance as compared to the IA algorithm. However, the sum 
rate maximization algorithm outperforms the sum MSE minimization algorithm on average. 
This shows that minimizing the sum MSE does not necessarily achieve high sum rates. At high 
pseudo SNRs, interferences become more harmful. As IA aims at perfectly nullifying all the 
interferences, the sum rates achieved by the IA algorithm increase approximately linearly with the 
pseudo SNRs and the slope is related to the achieved degrees of freedom (DoFs). Furthermore, 
if the sum MSE minimization and the sum rate maximization algorithms are able to find the 
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Fig. 4. Probability density of the average sum rate per time slot at the pseudo SNR 7 p snr = 30 dB for a scenario with K = 2, 
M Nb — 3, R = 4, and IVr, = JVm — 2 


global optima, all three curves should have the same slope at high pseudo SNRs. However, as the 
total available power increases, the feasible region described by the constraint sets of (l20l) and 
(l2TI) enlarges and this complicates the search for a good local optimum for both the sum MSE 
minimization and the sum rate maximization algorithms. As a result, both algorithms cannot 
achieve the same DoFs as the IA algorithm. 

Next we will take a closer look at the convergence of the proposed sum rate maximization 
algorithm. In Fig. the approximated probability density of the sum rates achieved by the 
proposed sum rate maximization algorithm, the sum MSE minimization algorithm, and the IA 
algorithm at a pseudo SNR of 30 dB are shown. One can observe that the IA algorithm sometimes 
achieves a high sum rate but the average performance remains low. This implies that the SNR at 
each MS may vary across a wide range depending on the channel realization. The performance 
of the sum MSE minimization algorithm is more stable than that of the IA algorithm because the 
received useful signal powers are forced close to the transmit signal powers, i.e., the gains of the 
useful links are close to one. Finally, the proposed sum rate maximization algorithm achieves the 
highest average sum rate with the smallest variance among the three considered algorithms in this 
case. For a randomly given channel realization, the algorithm converges, with high probability, 
to a solution which achieves a sum rate in the range between 14 bits per channel use and 17 
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Fig. 5. Average sum rate versus the number of iterations at the pseudo SNR 7 p snr = 30 dB for a scenario with K = 2, 

Af — Nb — 3, R — 4, and Mu — Nm — 2 

bits per channel use. However, for some channel realizations, the algorithm may also converge 
to solutions achieving a sum rate of about 13 bits per channel use or 18 bits per channel use. 
The reason is that the sum rate maximization algorithm is not guaranteed to achieve a global 
maximum. If the auxiliary variables w and t are fixed, the optimization problem of (I40l)- (l42l) 
is similar to a weighted sum MSE minimization problem. How to find the global optimum for 
such a problem is still an open question. In fact, alternatingly adapting the sets of optimization 
variables may result in that one or several users are turned off. In our simulation results for 
instance, it may happen that zero, one, or even two of the six MSs are turned off depending 
on the pseudo SNR and the channel realizations. Because of this, the IA algorithm can even 
outperform the proposed sum rate maximization algorithm at very high pseudo SNRs. 

Figure [5] shows the average sum rate versus the number of iterations of the considered 
algorithms for the first 50 iterations at a pseudo SNR of 30 dB. Since reducing interferences 
does not guarantee an increment of the sum rate, the sum rate achieved by the IA algorithm 
converges. The average sum rate achieved by the sum MSE minimization algorithm slowly 
increases with the number of iterations. As compared to the sum MSE algorithm, the proposed 
sum rate maximization algorithm not only converges faster but also converges to a higher sum 
rate on average. The main reason is that the auxiliary variables w and t are adapted in every 
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iteration to help maximizing the sum rate. Furthermore, since these auxiliary variables can be 
calculated in closed form, our sum rate maximization algorithm is comparable with the sum MSE 
minimization algorithms in terms of its computational complexity, which is mainly determined 
by the quadratic optimization tools used for optimizing the transmit filters at the BSs and the 
relay processing matrices. 


VII. Conclusion 

In this paper, the sum rate maximization problem in cellular networks is considered. It is 
shown that by adding two sets of auxiliary variables, this problem can be formulated as a multi- 
convex optimization problem. The property of multi-convexity in the new formulation makes it 
possible to find a local optimum using a low complexity iterative algorithm. The new proposed 
multi-convex formulation is not limited to our considered scenario, but it can be applied to many 
multiuser wireless system in which the estimated data symbols are multi-affine functions of the 
system variables. 
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